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ABSTRACT 



Described is an NSF sponsored five week summer 
institute for 35 teachers and administrators interested in 
implementing AAAS Science - A Process Approach. Prior to the 
institute, interaction data were gathered while observing 18 of the 
30 teachers teaching a science lesson of their own choice. The 
composite matrix indicated that someone was talking approximately 80 
percent of the time; approximately 52.7 percent of the time it was 
teacher talk. The format of the institute included the activities of 
the AAAS Guide for Inservice Instruction. In addition, a series of 11 
experimental stations were set up the final week and the participants 
worked on these experiments which reguired a synthesis of process 
skills. Pre- and post-measure scores on the Science Process Measure 
for Teachers indicated that prior to instruction the participants had 
a mean score of 11.40 out of a possible 25. After instruction, the 
group mean was 20.86. The results of the pre- institute interaction 
observations were used along with audio-training tapes to acquaint 
the teachers with the Flanders System. Post— institute interaction 
data (collected on 9 teachers) indicated that the category of silence 
or confusion increased from 17.93 percent to 29.80 percent. Teacher 
talk was reduced very slightly and student talk was reduced from 
29.37 to 19.54 percent. (BR) 
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ASSESSMENT OF THE AAAS SCIENCB - A PROCESS 
APPROACH mSTITOTE-A OOOPERATIVB CQUESI-SCHOOL SdENCB PROJECT 
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William S. LaShier, Jr. 




ill 


KANSAS STATE TEACHERS OOLIEGE 





EMPORIA, KANSAS 



One of the major challenges facing researchers in sciencse 
education is to establi^ the credibility of our researdi %#ith 
science teacdiers %dio might be expected to reap benefits from our 
efforts. It is sometimes difficult for teadiers to understand or 
appreciate the potential of educational researdi for improving 
teacher effectiveness in the classroom. The MSP Cooperative 
College-School Science Program provides an excellent opportunity 
to involve teachers in research techniques and interpretation of 
data relevant to teaching. 

The purpose of this paper then is to describe a MSP spwisored 
five meek susmer institute for 35 teaAers and ad min istrators 
interested in iiqplementing AAAS Science— A Process Approach. 
Particular attention will be focused on the involvement of 
teadiers in the evaluative aspects of the supner program and 
die sidisequent academic year implementation. 

Thirty elementary school teadiers £md five administrators 
were selected as institute participants from 13 rural school 
districts comprising the Flint Hills Educ^-tional Research and 
Development Association in south central Kansas. In April and 
May of 1969, the Flanders System of interaction analysis was 

This paper was presented at the annual NARS^ Meeting, March 
7, 1970, in Minneapolis, Minnesota. 
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U86d In 18 of tho 30 clnssrooas to provide e oonposite y of 
claserooB voxl>al interaction existing prior to the sunner 
institute progrns. It was anticipated that classroon observations 
conducted the following year would indicate areas of diange perhiyps 
attributable to a oonbination of siasMr institute work and use of 
the new science materials. A OGsg»arison of this phase of the 
study will be discussed later in the piyper. 

The 1969 five week susmer institute was held in the Science 
Building on the canpus of Kansas State Teachers College and in the 
nearby Butcher Elenentary canpus sdiool. Or. Ed Kurtz was the 
co-director of the project and Mr. Berb Slssions was the coordinator 
of tdie nicro-teacdiing phase of the progran. 

The fomat of the institute included the activities 
suggested in the AAAS Guide for In-service Training . In 
addition, a series of 11 ejcperinental stations were set iqo the 
fifth week to encourage the participants to % 0 Odc on AAAS exercises 
Whidi required a synthesis of the individual process skills which 
had been previously developed. 

Ihe participants also observed and worked with four afternoon 
classes of first and second grade students in Butcher Elesnntary 
School. Mr. Herb Si n wo n s taught AAAS science exercises the first 
week and the participants observed through sound booths equipped 
with one way glass. During the next three weeks teans of two 
teadiers worked with groups of three and four students. In the 
final week each participant worked with one dilld. Selected 
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activities from 24 AAAS exercises in Parts A, B, and C were 
taught in the four classes during the five week period. 

The participants received personal copies of the AAAS 
Commentary for Teachers ; response sheets for AAAS Guide for 
In-service Instruction ; and either Peurt B or Part C teacher texts 
for the RAAS Science- A Process Approach . Individual copies of 
a book by Amidon and Flanders » The Pole of the Teacher in the Classroom 
A Manual for Understanding and Improving Teacher Classroom 
Behavior were also provided. 



Science Process Measure for Teachers 



The effectiveness of the summer institute was reflected 
in part by the pre-to post-measure gain in comnetency baised on 
the Science Process Measure for Teachers , forms A and 3. The 
pre-measure was administered on the second day of the institute 
and served as a means both of obtaining data and of informing 
the teachers as to the nature of the process skills which would 
be investigated in the program. The post-measure was administered 
at the end of the institute. 

The auialysis of the scores on the pre-and post-measures of 
the teachers provided the folloi^ing statistics; 

Pre-Measure Post-Measure t-Test 



Score Possible •> * 25 

Subjects 35 

Mean 11,40 

Standard Deviation 4.67 

R^mge 3-20 



25 

35 

20.86 11.3^ 

2.15 
15-24 



^SignificcUit beyond the .001 level 



The accompanying graph indicates the relative gain in 
conpetence in nine areas stressed in the Science Process Measure 
for Teachers. The post-neasure results indicated that on five of 
the nine sections of the test the mean score was above the 90th 
oercentile . Onlv two mean sub-scores » Classifying and Use of 
Behavioral Objectives, were belov; the 80th percentile. 

Set of Competency Tasks 

In anticipation of the need to provide the participants 
v/ith pertinent and understandable data as to the process skills 
possessed by first and second grade students, two testing 
instruments were developed by the project staff. The Set of 
Cf>mpetency Tasks, Parts A and B consisted of 112 tasks selected 
from existing competency measures associated with 34 exercises 
in Parts A and B cf Science- /^ Process Approach. A second test. 
The Set of Competency Tasks , ^arts B and C, consisted of 105 
competency tasks selected frora 24 exercises in Parts B and C of 
Science- A Process Approach . 

The participants viewed a video-taped testing seouence and 
discussed the procedures and ground rules for administering the 
tests. In teams of two, the participants next went through one 
of the tests and familiarized themselves with the questions and 
supplies. Since each instrument required approximately one and 
a half h' urs-.to' adniniste'r,^ each v.instrumeAt was'divide " int^ 



COMPARISON OF MEAN SCORES ON THE PRE- AND POST-MEASURES OF 35 TEACHERS 
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two parts. Each team of testers spent a full day administering 
-one of the rarts of the instrument!? to four to*-six students in 

tiieir resnective school districts. 

The combined test results were analyzed by the peurticipants 
in terms of where one might begin teaching a particular process, 
such as measuring. In addition, each team of teachers, obtained 
information concerning a small samiple of students that they would 
be instructing in the 1969-70 school year. The results of this 
study are presented in Tables I and II. Hie mean responses to 

individual tasks are combined under eight process headings. 

\ 

The project staff conducted a testing nrogreun usinc the 
same instruments as ■ a part of a pre- and noot-test design. This 
^ata is- also included in Tables I and. II . 

The data on the Set of Competency Tetsks , Parts A and B 
indicated that when the tests vrere administered by teachers that 
the mean student scores were higher on five of the six sub-tests 
in cconpcurison wi 'di the student tested by the staff . 

If one could assume that the two student population samples 
were simil 2 ur in ability it vrould appeeir that the teachers might 
hav<i tended to read too much into the students* responses. This 
possibility was discussed with the institute participants since 
they were expected to gather competency measure data on individual 
exercises during the academic year. The data from the Set of 
Competency Tasks , Part B and C neither supported nor refuted the 
possibility of observer bias in the administering of the test. No 
detailed statistical ^lnalysis was attempted since the contrasting 
data were collected for two differect purposes under different conditions. 
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TABLE I 

MEAN SUB'SCORES ON SET OF COMPETENCY TASKS PANTS A AND B 
FOR TWO GROUPS OF FIRST GRAI^RS 



MEAN ACCEPTABLE RESPONSES TOTAL POSSIBLE SCORE 
' Tested PY Tested by 

Participgmt Staff 



Observing 


(N»47<i>28) 

9.7 


(N*30+25) 

5.7 


16 


Measuring 


10.8 


6.7 


21 


Clcissifying 


5.3 


3.9 


8 


Using Numbers 


8.5 


8.9 


19 


CoDDunicating 


6.4 


3.5 


21 


Space/Time 


11.3 


11.1 


27 



TABLE II 

MEAN SUB-SCORES ON SET OF COMPETENCY TASKS, PART B AND C 
FOR TWO GROUPS OF SECOND GRADERS 



MEAN ACCEPTABLE 


RESPONSES 


TOTAL POSSIBLE SCORE 


Tested by 
ParticipcUit 


Tested by 
Staff 




(N*30+21) 


(N-26+27) 





(X>serving 


5.4 


6.3 


8 


Classifying 


4.2 


4.8 


10 


Measuring 


7.3 


7.5 


18 


Comnunicating 


5.4 


4.0 


19 


Using Nundbers 


9.4 


9.6 


18 


Space/Time 


3.7 


2.1 


7 


Predicting 


3.8 


2.9 


12 


Inferring 


7.6 


4.9 


13 
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Interaction Analysis 

The Flanders System of interaction analysis was used to 
gather data on the teacher-pupil verbal interaction in 18 
classrooms prior to the sunmer institute. Each of the 18 
teachers was observed while teaching an independently planned 
science lesson. The resulting con^site matrix, composed of 
3,457 tallies, indicated that on the average 52.7 per cent of the 
total class time involved teacher talk, student talk accounted 
for 29.4 per cent of the total time and silent activities or 

confusion accounted for 17.9 per cent of the time. 

The results of the pre-institute interaction observations 

were used along with audio training tapes to acquaint the 
teachers with the Flanders System of interaction analysis. The 
purpose of this ten hours of training was to provide the 
participants with one system for quantifying verbal interaction 
during the observation phase of the institute and at the same 
time to suggest a way for each individual to look at his own 
teaching style when he returned to the classroom. 

The in-service phase of this project is currently underway 
and it is not possible at this time to fully assess the changes 
in classroom interaction. However video-tapes of nine par- 
ticipants using the AAAS materials have been tabulated using 
interaction analysis and the results are given in Table III 
along with data from the pre-institute observations. 



In comparing the post-institute interaction data with the 
pre-institute observational data, it appears that the category of 
silence or confusion has increased from 17.93 per* oent to 29.80 
per cent reflecting more student involvement. Teacher talk has 
been reduced only slightly and student talk has been reduced from 
29.37 per cent to 19,54 per cent. The v^□^ious I/D Ratios have 
only changed slightly. 



Ti^LE III 



PRE AND POST-MEASURES OP INTERACTION ANALYSIS FACTORS 



* 



Pre-Measure 
Spring of 1969 
(Ns=18 teachers) 



Post-Measure 
Pall of 1969 
(K*9 teachers) 



Revised I/D Ratio 
Extended Indirect 
Extended Direct 



Per Cent Column 1 
Per Cent Column 2 
Per Cent Column 3 
Per Cent Column 4 
Per Cent Column 5 
Per Cent Column 6 
Per Cent Column 7 
Per Cent Column 8 
Per Cent Column 9 
Per Cent Column 10 



Per Cent Teacher Talk 
Per Cent Student Talk 



I/D Ratio 



0.510 

0.501 

1.28 

3.67 

52.70 

29.37 

0.20 

5.73 

4.89 

16.05 

15.07 

8.94 

1.82 

17.62 

11.74 

17.93 



0.599 

0.465 

1.25 

4.64 

50.66 

19.54 

0.55 

6.24 

5.61 

17.95 

6.03 

12.82 

1.46 

13.58 

5.96 

29.80 



* Data to eventually include 18 teachers 



Assessment of the Academic Year In-Service 



Six of a series of twelve half day in-service workshops 
have already been conducted. At the conclusion of each of these 
sessions brief assessment forms were filled out ainonyroously by 
the participemts . The form consisted of two or three statements 
outlining the principal activities of the session with a one to 
ten scale to be marked. This informal feed back from ein average 
of 20 teachers was useful in plcinning subsequent sessions. Scane 
of the activities that were well received included; disciiscion 
in small groups, observation cind discussion of video-tapes of 
participants teaching, presentation on central supply systems, 
auid discussion by Dr. Kurtz regarding AAAS programs underway in 
other parts of the country. 

The concluding phase of the assessment of the academic year 
phase will be based on post-measure data gained from the two Set 
of Competency Tasks administered to the experimental and control 
groups of first and second grade students. 

The Teacher Feedback forms will also provide information 
regarding preparation time, instructional time, student interest, 
and teacher eissessment of each exercise taught. The participants 
have also agreed to administer competency measures to three 



students 



after each of five exercises. 



Limitations and RecoBwendations 
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A substantial portion of the sunsaer institute was directed 
toward teacher involvement with students in the Cein^jus school. 

It would seem that instead of inititally projecting the participants 
into teaching situations with observers present it %rould have 
been better to let the teachers initiallly administer competency 
measures after several complete exercises had been taught by a 
staff member. This would be followed by one to c«ie teaming, .and 
eventually one teacher working with a small group. 

The potential of the interaction analysis training would have 
been enhanced if all teachers could have been video taped while 
teaching, then each teacher could have constructed his own matrix 
for interpretaion. Ideally the teacher should be video taxied 
several times to provide him with an opportunity to attempt to 
alter his teaching and receive feedback. 

The opportunity to work at eleven experimental stations was 
seemingly a successful culminating activity during the last week 
of the institute. It would be interesting to lengthen the period 
in which the teachers could investigate a particular problem and 
determine whether the teachers demonstrated interest in repeating 
an experiment or in altering their problem solving approach. 

In summary the participants in the sumner program actively 
engaged in improving their own intellectual skills in preparation 
for working with students. The concept of behavioral objectives 



as a basis for instruction and ^lssesslnent of the progress of 
students was hopefully reinforced by the micro-teaching activities 
2md the gathering of competency task data from students. 

The half day in-service meetings! held to date have i->roviddd 
the teadiers an opportunity to compare notes r discuss prdt>lemsr and 
receive encouragement from one ^Lnother• Hie staff has attempted 
to provide experiences which would provoke discussion and encourage 
cheinge on the part of the teachers. 



